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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to 10 Apr 2009 . 

2. ^ The allowed claim(s) is/are 33-39 and 41 (renumbered 1-8 respectively) . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1. 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 
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DETAILED ACTION 

This action is responsive to communications: Remarks filed 10 Apr 2009. 
Claims 1 , 2, 5-1 5, 23 and 29-42 are pending in this case. Claims 1 , 5, 1 4, 1 8, 27 
and 31 are independent claims. 

Examiner's Note 

Previous specification objection regarding Claim 37 is withdrawn. 

Examiner's Amendment 

An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with Ido Tuchman on 17 Jun. 2009. 

In the claims: 

Claims 1-32 (canceled) 

Claim 33. (previously presented) Method for generating persistent 
annotations of multimedia content, comprising one or more repetitions of the following 
steps: 
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actively selecting examples of multimedia content to be annotated by a user, 
wherein the examples of multimedia content are selected based on at least one criterion 
for achieving a maximal disambiguation result such that only those examples which are 
most ambiguous are selected, wherein the at least one criterion is measured according 
to a model; 

accepting input annotations from said user for said selected examples; 
propagating said input annotations to other instances of multimedia content; 
storing said input annotations and said propagated annotations; and 
using said input annotations as training data to update the model. 

Claim 34. (previously presented) The method of claim 33, further 
comprising repeating the step of selecting examples of multimedia content, wherein the 
repeated step of selecting examples of multimedia content is performed according to 
the model updated by using said input annotations as training data. 

Claim 35. (previously presented) The method of claim 33, wherein the 
model uses at least one feature representation. 

Claim 36. (previously presented) The method of claim 35, wherein the at 
least one feature representation comprises a texture. 
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Claim 37. (previously presented) The method of claim 35, wherein the at 
least one feature representation comprises a cepstral coefficient. 

Claim 38. (previously presented) The method of claim 35, wherein the at 
least one feature representation comprises zero crossings. 

Claim 39. (previously presented) The method of claim 33, further 
comprising performing user verification when the step of propagating said input 
annotations has been performed with least confidence. 

Claim 40 (canceled) 

Claim 41 . (previously presented) Method for generating persistent 
annotations of multimedia content, comprising one or more repetitions of the following 
steps: 

actively selecting examples of multimedia content to be annotated by a user, 
wherein the examples of multimedia content are selected based on at least one criterion 
for achieving a maximal disambiguation result such that only those examples which are 
most ambiguous are selected; 

accepting input annotations from said user for said selected examples, wherein a 
rectangular region of an image is associated with at least one of said input annotations; 
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propagating said input annotations to other instances of multimedia content; and 
storing said input annotations and said propagated annotations. 

Claim 42 (canceled) 

Reasons for Allowance 

Claims 33-39 and 41 are allowed. 

The following is an examiner's statement of reasons for allowance: The closest 
prior art of record, namely Stubler et al. (U.S. 6,804,684 B2) and Toyama (U.S. 
6,816,847 B1), fail to teach or reasonably suggest the combination of limitations of the 
claimed invention. For example, the cited references fail to teach or reasonably suggest 
"actively selecting examples of multimedia content to be annotated by a user, wherein 
the examples of multimedia content are selected based on at least one criterion for 
achieving a maximal disambiguation result such that only those examples which are 
most ambiguous are selected." 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JAMES J. DEBROW whose telephone number is 
(571)272-5768. The examiner can normally be reached on 8:00-5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Doug Hutton can be reached on 571-272-4137. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

JAMES DEBROW 
EXAMINER 
ART UNIT 2176 

/Laurie Ries/ 
Primary Examiner 
Technology Center 2100 
18 June 2009 



